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METHOD AND APPARATUS FOR ASSOCIATING ENVIRONMENTAL 
INFORMATION WITH DIGITAL IMAGES 

Description 

5 BACKGROUND OF THE INVENTION 

The present invention relates generally to camera images, and more 
particularly, to associating environmental information with camera images, 
particularly digital camera images. 

As digital photography increases in popularity, common users will be able to 
10 store thousands of digital images, while professional photographers will need to store 
hundreds of thousands of images. As such, finding a stored image may be quite 
difficult for the typical photographer. 

One possible solution is searching the images for image content. This 
technique requires the user to specify some characteristic of the image, such as a tall 
15 building. A computer searching for the images must then search the images for this 
characteristic. This technique requires sophisticated software, which has thus far not 
been completely successful, and is not an efficient method for locating images. 

As such, there is a need for methods and apparati to improve ones ability to 
locate a digital image amidst a plurality of digital images. 
20 DESCRIPTION OF THE INVENTION 

Accordingly, the present invention is directed to a digital camera 
configuration that substantially obviates one or more of the problems due to 
limitations and disadvantages of the prior art. 

In accordance with the purposes of the invention, as embodied and broad I > 
25 described herein, the invention comprises a digital camera configuration including a 
digital camera for capturing a digital image, means for storing the digital image, 
means for generating environmental information, and means for storing the generated 
environmental information. In another aspect, the digital camera configuration 
includes means for receiving user information corresponding to a digital image tiui 
30 for storing this information. In yet another aspect of the invention, the digital ^ .imkt.i 
configuration includes means for storing information regarding the camera itsel; 
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The summary of the invention and the following detailed description should 
not restrict the scope of the claimed invention. Both provide examples and 
explanations to enable others to practice the invention. The accompanying drawings, 
which form part of the description for carrying out the best mode of the invention, 
5 show several embodiments of the invention, and together with the description, 
explain the principles of the invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Figure 1 is a block diagram of a digital camera configuration with means for 
generating environmental information, consistent with the invention; 
10 Figure 2 is a block diagram of a digital camera configuration with a flash and 

means for generating information regarding the flash, consistent with the invention; 

Figure 3 is a block diagram of a digital camera configuration with a camera 
identification code, consistent with the invention; 

Figure 4 is a block diagram of a digital camera configuration with a user 
15 interface, consistent with the invention; 

Figure 5 is a block diagram of a digital camera configuration with means lor 
generating user information, consistent with the invention; and 

Figure 6 is a block diagram of a digital camera configuration with a computer 
interface, consistent with the invention. 
20 BEST MODE FOR CARRYING OUT THE INVENTION 

Reference will now be made in detail to embodiments of the invention, 
examples of which are illustrated in the accompanying drawings. Wherever possible, 
the same reference numbers will be used throughout the drawings to refer to the same 
or like parts. 

25 Figure 1 illustrates a block diagram of a digital camera configuration 5 

according to a preferred embodiment of the invention. As shown in Figure 1 . the 
digital camera configuration 5 includes an image capture device 10, an Analou to 
Digital Converter (ADC) 20, a Digital Signal Processor (DSP) 30, means for 
generating environmental information 40, and a storage device 50. In a preferred 

30 embodiment the image capture device can be a Charged Coupled Device (CCD i. hut 
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Complementary Metalic Oxide Semiconductor (CMOS) devices are equally 
applicable to this invention, as well as other optical sampling devices which generate 
pixels. The image capture device 10 sends analog voltage information corresponding 
to image pixels to the ADC 20, which converts the analog signals into discrete binary 
5 signals. The digital output from ADC 20 is sent to DSP 30, which adjusts contrast 
and color balance, and subsequently compresses the image before sending it to the 
storage 50. The storage device, in a preferred embodiment, includes RAM chips, but 
in another embodiment, may comprise any appropriate storage medium such as, 
magnetic disks or memory cards. 

10 In another embodiment, the image capture device 10 can be a complementary 

metal-oxide semiconductor (CMOS). Because of the nature of CMOS, it is possible 
to task the CMOS with other responsibilities, such as the Analog to Digital 
Conversion (ADC) and some signal processing tasks. 

In addition to the above, the digital camera configuration 5 of the preferred 

15 embodiment also includes means for generating environmental information 40 

associated with a digital image. Environmental information includes information 
relating to the environment in which a digital camera image is captured. For 
example, environmental information includes location, the lighting conditions, 
altitude, odor, camera orientation, and various atmospheric conditions, of which 

20 temperature, humidity, wind speed and direction are examples. In one embodiment, 
an Analog to Digital Converter (ADC) is used to convert analog signals which 
describe the environmental information into a digital form prior to storing the 
information in storage 50. In another embodiment, the means for generating 
environmental information generates digital information directly. 

25 In a preferred embodiment, the digital environmental information is sent to 

DSP 30, which combines the environmental information with the captured image and 
sends both digital data sets to storage 50. 

In one embodiment, the environmental information is stored by storage 50 in 
files ancillary to the captured digital image. In another embodiment, the 

30 environmental information is embedded within the digital image file stored in storage 
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50 by using fields reserved in that file for user information. In another embodiment, 
the environmental information is imbedded in the image itself by an encoding 
technique that modifies the information in the image in such a way that the image 
visually appears unaltered but the environmental information is recoverable using 
5 special techniques. This is sometimes known as watermarking. In this case as well, 
the digital information is ultimately stored in storage 50. 

In a preferred embodiment the means for generating environmental 
information includes a location-sensing device so that the camera's location at the 
time of digital image capture can be determined. Location information can include 
10 longitude and latitude (as well as altitude) as determined by a Global Positioning 
Satellite system (GPS), or the latitude and longitude could be converted into an 
address using maps, such as Sony's Etak system. 

In another embodiment, the means for generating environmental information 
includes a light spectrum analyzer for generating information regarding the lighting 
1 5 conditions at the instant of image capture. 

In another embodiment, the means for generating environmental information 
includes a humidity sensing device, such as solid-state sensor which compares air 
moisture to a sealed air sample as a reference. Humidity sensors provide digital 
signals which represent the relative humidity at their sensing location. 
20 In another embodiment, the means for generating environmental information 

includes a digital thermometer for generating information regarding the temperature 
when a digital image is captured. 

In another embodiment, the means for generating environmental information 
includes an altimeter to provide information on elevation relative to sea level. Other 
25 forms of altimeters could also be used for providing information regarding how high 
the camera was above the ground when a digital image was captured. Ultra-sonic 
sensors, which are used to determine distance from the sensor to a reflecting surface, 
could be mounted on the bottom side of the digital camera to determine the distance 
from the camera to a support surface. Multiple time samples of this information 
30 could be used in this invention to determine if the camera is held by a human being. 
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with the attendant motion of the camera prior to image capture, or by a tripod or 
similar device which would have a very constant distance from the camera to the 
support surface. 

In another embodiment, the means for generating environmental information 
5 includes a rangefmder for generating information regarding the distance between the 
digital camera and the object being photographed. The rangefmder can be optical 
(using edge sharpening techniques) or sonic to provide accurate digital distances 
from the camera sensor to the object located in the center of the camera viewfmder. 

In another embodiment, the means for generating environmental information 
1 0 includes an inclinometer for generating information regarding the orientation of the 
camera on three axes at the time a digital image is captured. 

In another embodiment, the means for generating environmental information 
includes a gas chromatograph for providing information regarding odors where the 
digital image is captured. This information can include odors such as bromine and 
1 5 methane, or gas concentrations such as the relative amounts of oxygen or nitrogen or 
nitrogen-oxides that might be present in the location when the image is captured. 

In another embodiment, the means for generating environmental information 
includes an accelerometer for generating information regarding movement of the 
camera at the time a digital image is captured. 
20 In another embodiment, the means for generating environmental information 

includes an anemometer for generating information regarding wind speed and 
direction at the time a digital image is captured. 

In another embodiment, the means for generating environmental information 
includes a barometer for generating information regarding atmospheric pressure at 
25 the time a digital image is captured. 

In another embodiment, the means for generating environmental information 
includes a compass for generating information regarding the direction or orientation 
of the camera at the time a digital image is captured. 
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In another embodiment, the means for generating environmental information 
includes a depth meter for generating information regarding how far underwater the 
digital camera is at the time a digital image is captured. 

As shown in Figure 2, in another embodiment the digital camera 
5 configuration 5 includes a flash 110, and means for generating information regarding 
the flash 140. In this embodiment, the digital camera configuration 5 generates and 
stores information regarding characteristics of the flash used by the digital camera 
configuration 5 when a digital image is captured. For example, flash intensity, flash 
duration, flash orientation relative to the optical axis of the camera, and flash 
10 feedback from its sensing element measuring the reflected light coming back from 
the photographed scene. 

As shown in Figure 3, in another embodiment, the digital camera 
configuration 5 stores a camera identification code 210. In this embodiment, the 
digital camera configuration 5 stores information regarding the camera identification 
1 5 code for the camera associated with a capture digital image. For example, this code 
is often a serial number of the camera that is unique to that model of camera. 
Another example of the camera identification code is the a digital model number or 
serial number of the lens being used during the photograph, or of the specific type of 
filter used with the camera, of the specific type of flash unit attached to the camera. 
20 In another embodiment, the digital camera configuration 5 stores information 

regarding a film identification code associated with film used by the digital camera 
configuration 5 when a digital image is captured. The film used here might be the 
type of conventional film used in a dual exposure camera where a digital image and a 
conventional film image are captured at the same instant. This film type could be 
25 specialized optical film to capture different spectra from the scene other than the 

conventional optical spectra. Examples of these other spectra are Ultraviolet (UV ) 
and Infrared (IR). Sampling of radio wave emissions could be taken at the same time 
as the digital optical information and that radio wave signal could be digitized and 
included as part of the environmental identification. 
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As shown in Figure 4, in another embodiment, the digital camera 
configuration 5 includes an input/output interface 310. In one embodiment, the 
digital camera configuration 5 is capable of receiving user information input 
associated with a captured digital image through a keyboard or digital writing pad 
5 via input/output interface 310. 

In another embodiment, the digital camera configuration 5 is capable of 
receiving user information input associated with a captured digital image through a 
microphone via input/output interface 310? 

In another embodiment, the digital camera configuration 5 is capable of 

10 receiving user information associated with a captured digital image input through a 
Personal Digital Assistant (PDA) via user interface 310. 

As shown in Figure 5, in another embodiment, the digital camera 
configuration 5 includes means for generating information regarding an eye of a 
photographer for a captured digital image 410. This information can include, e.g., 

15 information regarding an iris or other part of the eye of the photographer. This 

information could indicate the retinal pattern of the photographer's eye as a means of 
uniquely identifying the photographer, or as a means of determining where the 
photographer was looking into the scene in the viewfinder to help identify the 
dominant object in the scene. 

20 In another embodiment, the digital camera configuration 5 includes means for 

generating information regarding a fingerprint of the photographer for a captured 
digital image. Using an optical window on the side of the digital camera, the 
photographer's fingerprint could be captured during the scene capture using either the 
same image capture element as used for the primary scene (typically CCD or CMOS 

25 device) or the fingerprint device could be an entirely different sensor. New 

fingerprint sensors are becoming available which image a fingerprint by non-optical 
means. This invention covers all types of fingerprint sensor mechanisms. 

As shown in Figure 6, in another embodiment, the digital camera 
configuration 5 includes a computer interface 510 for connecting the digital camera 

30 configuration 5 to a computer. Through this interface the digital camera 5 can 



WO 00/45587 



PCT/US00/01710 



8 



receive information associated with a captured digital image from the computer. The 
digital camera configuration 5 then stores the information received from the 
computer in a manner that the received information is associated with the digital 
image. As previously noted, there are two preferred methods for storing this 

5 information: in ancillary files, or by embedding the information in the stored image. 

While it has been illustrated and described what is at present considered to be 
the preferred embodiment and methods of the present invention, it will be understood 
by those skilled in the art that various changes and modifications may be made, and 
equivalents may be substituted for elements thereof without departing from the true 
1 0 scope of the invention. 

In addition, many modifications may be made to adapt a particular element, 
technique or, implementation to the teachings of the present invention without 
departing from the central scope of the invention. Therefore, it is intended that this 
invention not be limited to the particular embodiment and methods disclosed herein, 

15 but that the invention includes all embodiments falling within the scope of the 
appended claims. 
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WHAT IS CLAIMED 

1 . A digital camera configuration comprising 

means for capturing a digital image (10); 
means for storing the digital image (50); 

means for generating environmental information corresponding to the digital 
image (40); and 

means for storing the environmental information (50). 

2. The digital camera configuration of claim 1, 

wherein the means for generating environmental information includes a 
location sensing device. 

3. The digital camera configuration of claim 2 wherein the location sensing device 
communicates with a Global Positioning Satellite system for generating information 
regarding a location where the digital image is captured. 

4. The digital camera configuration of claim 2 wherein the information regarding the 
location includes information regarding the longitude, latitude, and/or elevation of 
the location where the image is captured. 

5. The digital camera configuration of claim 4 further comprising, 

means for converting the latitude and longitude into an address using a map 

(30). 

6. The digital camera configuration of claim 4, * 

wherein the means for generating environmental information includes a light 
spectrum analyzer. 
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7. The digital camera configuration of claim 1, 

wherein the means for generating environmental information includes a 
humidity sensing device. 

8. The digital camera configuration of claim 1, 

wherein the means for generating environmental information includes a 
thermometer. 

9. The digital camera configuration of claim 1, 

wherein the means for generating environmental information includes an 
altimeter. 

10. The digital camera configuration of claim 1 , 

wherein the means for generating environmental information includes a 
rangefinder for generating information regarding a distance between the camera and 
an object. 

1 1 . The digital camera configuration of claim 1, 

wherein the means for generating environmental information includes a 
inclinometer. 

12. The digital camera configuration of claim 1, 

wherein the means for generating environmental information includes a gas 
chromatograph. 

13. The digital camera configuration of claim 1, 

wherein the means for generating environmental information includes a 
accelerometer. 
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1 4. The digital camera configuration of claim 1 , 

wherein the means for generating environmental information includes an 
anemometer. 

15. The digital camera configuration of claim 1, 

wherein the means for generating environmental information includes a 
barometer. 

16. The digital camera configuration of claim 1, 

wherein the means for generating environmental information includes a 
compass. 

1 7. The digital camera configuration of claim 1, 

wherein the means for generating environmental information includes a depth 

meter. 

1 8. The digital camera configuration of claim 1, 

wherein the means for generating environmental information includes means 
for generating information regarding non-visible light. 

19. A digital camera configuration, comprising 

means for capturing a digital image (10); 
means for storing the digital image (50); 

means for receiving user information corresponding to the digital imaue 

(310); 

means for storing the user information (50). 
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20. The digital camera configuration of claim 19, 

wherein the means for receiving user information includes means for 
receiving information from a keyboard or digital tablet. 

2 1 . The digital camera configuration of claim 1 9, 

wherein the means for receiving user information includes means for 
receiving information from a microphone. 

22. The digital camera configuration of claim 19, 

wherein the means for receiving user information includes means for 
receiving information from a Personal Digital Assistant. 

23. The digital camera configuration of claim 19, further comprising 

wherein the means for receiving user information includes means for 
generating information regarding characteristics of an eye of a photographer. 

24. The digital camera configuration of claim 23, 

wherein said characteristics of an eye include at least one of an eye and an 

iris. 

25. The digital camera configuration of claim 19, further comprising 

wherein the means for receiving user information includes means for 
generating information regarding a fingerprint of a photographer. 

26. A digital camera configuration comprising, 

a flash (110); 

means for capturing a digital image (10); 
means for storing the digital image (50); and 

means for storing information regarding characteristics of the flash (5(u. 
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27- A digital camera configuration comprising, 
means for capturing a digital image (10); 
means for storing the digital image (50); and 

means for storing a camera identification code with the digital image (50). 

28. A digital camera configuration comprising 
means for capturing a digital image (10); 
means for storing the digital image (50); and 

means for storing a film identification code with the digital image (50). 



29. A digital camera configuration, comprising 

means for capturing a digital image (10); 

means for storing the digital image (50); 

means for connecting the digital camera to a computer (510); 

means for receiving information from the computer (510); and 

means for storing the information received from the computer (50). 

30. A method for capturing a digital image and associated environmental 
information, comprising the steps of 

capturing a digital image; 
storing the digital image; 

generating environmental information corresponding to the digital image; and 
storing the environmental information. 



3 1 . The method of claim 30, 

wherein the generated environmental information includes information from a 
location sensing device. 
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32. The method of claim 3 1 , 

wherein the location sensing device communicates with a Global Positioning 
Satellite system for generating information regarding a location where the digital 
image is captured. 

33. The method of claim 31 wherein the information from the location sensing 
device includes information regarding the longitude and latitude of the location 
where the image is captured. 

34. The method of claim 33, further comprising the step of 

converting the latitude and longitude into an address using a map. 

35. The method of claim 30, 

wherein the generated environmental information includes information from a 
light spectrum analyzer. 

36. The method of claim 30, 

wherein the generated environmental information includes information from a 
humidity sensing device. 

37. The method of claim 30, 

wherein the generated environmental information includes information from a 
thermometer. 

38. The method of claim 30, 

wherein the generated environmental information includes information from 
an altimeter. 
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39. The method of claim 30, 

wherein the generated environmental information includes information from a 
rangefinder regarding a distance between the camera and an object. 

40. The method of claim 30, 

wherein the generated environmental information includes information from 
an inclinometer. 

4 1 . The method of claim 30, 

wherein the generated environmental information includes information from a 
gas chromatograph. 

42. The method of claim 30, 

wherein the generated environmental information includes information from 
an accelerometer. 

43. The method of claim 30, 

wherein the generated environmental information includes information from 
an anemometer. 

44. The method of claim 30, 

wherein the generated environmental information includes information from a 
barometer. 

45. The method of claim 30, 

wherein the generated environmental information includes information from a 
compass. 
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46. The method of claim 30, 

wherein the generated environmental information includes information from a 
depth meter. 

47. The method of claim 30, 

wherein the step of generating environmental information includes generating 
information regarding non-visible light. 

48. A method of capturing a digital image, comprising the steps of 

capturing a digital image; 
storing the digital image; 

receiving user information corresponding to the digital image, 
storing the user information. 

49. The method of claim 48, 

wherein step of receiving user information includes receiving information 
from a keyboard or digital tablet. 

50. The method of claim 48, 

wherein the step of receiving user information includes receiving information 
from a microphone. 

5 1 . The method of claim 48, 

wherein the step of receiving user information includes receiving information 
from a Personal Digital Assistant. 

52. The method of claim 48, further comprising 

wherein the step of receiving user information includes generating 
information regarding characteristics of an eye of a photographer. 
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53. The method of claim 52, 

wherein said characteristics of an eye include at least one of an eye and an 

iris. 

54. The method of claim 48, further comprising 

wherein the step of receiving user information includes generating 
information regarding a fingerprint of a photographer. 

55. A method for capturing a digital image wherein the digital camera configuration 
includes a flash, comprising the steps of 

capturing a digital image; 
storing the digital image; and 

storing information regarding characteristics of the flash. 

56. A method of capturing a digital image, comprising the steps of 

capturing a digital image; 
storing the digital image; and 

storing a camera identification code with the digital image. 

57. A method for capturing a digital image, comprising the steps of 

capturing a digital image; 
storing the digital image; and 

storing a film identification code with the digital image. 

58. A method for capturing a digital image, comprising the steps of 

capturing a digital image; 

storing the digital image; 

connecting the digital camera to a computer; 

receiving information from the computer; and 

storing the information received from the computer. 
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